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Abstract 

Internationally, a growing number of interprofessional education (IPE) offices 
are being established within academic institutions. However, few are applying 
educational improvement methodologies to evaluate and improve the inter¬ 
professional (IP) learning opportunities offered. The University of Manitoba 
IPE Initiative was established in 2008 to facilitate the development of IP learn¬ 
ing opportunities for pre-licensure learners. The research question for this sec¬ 
ondary analysis was: what, if any, changes in the number and attributes of IP 
learning opportunities occurred in the academic year 2008-2009 compared to 
2011-2012? The Points for Interprofessional Scoring (PIPES) tool was used to 
quantify the attributes of each IP learning opportunity. Most notably in 2012, 
eight (73%) of 11 IP learning opportunities achieved the highest PIPES score (> 

55), compared to only four (36%) in 2009. The concept of the PIPES score is 
introduced as an educational improvement strategy and a potential predictor 
of achieving the desired educational outcome: collaborative competence. 
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Resume 

Les institutions academiques du monde accueillent de plus en plus de bureaux 
d’education interprofessionnelle. Par contre, tres peu mettent en pratique des 
methodologies d’amelioration de renseignement pour evaluer et ameliorer 
ces occasions d’apprentissage interprofessionnelles (OAI). En 2008, afin de 
faciliter la creation de telles occasions pour les apprenants avant l’obtention 
de leur permis de pratique, l’Universite du Manitoba lanqait l’initiative 
d’education interprofessionnelle. Elle voulait savoir s’il existait des differences 
dans les nombres et les attributs des OAI entre les annees 2008-2009 et 2011- 
2012. Les attributs de chaque OAI ont ete quantifies en utilisant une version 
adaptee del’outil« Points for Interprofessional Scoring » ou (PIPEs). En 2012 
notamment, 73 % d’occasions d’apprentissage interprofessionnel (soit 8 sur 
11) avait atteint le score PIPES (>55) le plus eleve, comparativement a 36 % 
en 2009. Le concept du score « PIPES » est presente comme une strategic 
d’amelioration du secteur de l’education et comme un potentiel de prediction 
du resultat educationnel desire : une competence collaborative. 

Interprofessional education (IPE) is an emerging global priority for educators in 
health professional programs. Evidence suggests that when health professionals are edu¬ 
cated together and have knowledge of not only their own skills, but also the skills and 
attributes of other members of the healthcare team, and when these teams work together 
with the patient to decide on a course of treatment, the safety, quality, and access to care 
are better, and patient outcomes improve. Further, highly collaborative teams experience 
reduced tensions and conflict, leading to improved job satisfaction, recruitment, and re¬ 
tention among healthcare providers (Health Force Ontario, 2010; Reeves, Perrier, Gold¬ 
man, Freeth, & Zwarenstein, 2013; Zwarenstein, Goldman, & Reeves, 2009). However, 
as illustrated by the D’Amour Interprofessional Education for Collaborative Person-Cen¬ 
tred Practice (IECPCP): Evolving Framework, structuring an IPE curriculum to achieve 
collaborative competence is complex and influenced by an array of political, regulatory, 
geographical, institutional, instructional, student, and faculty characteristics and dynam¬ 
ics (D’Amour & Oandasan, 2005). Recognizing these diverse and often immutable influ¬ 
ences, Freeth (2004) suggested that IP educators apply the 3P model of learning and 
teaching in their planning of an IPE curriculum. This model identifies multiple “presage” 
(contextual) and “process” (delivery) factors that need to be considered when planning 
interprofessional (IP) learning opportunities to achieve the desired “product” of collab¬ 
orative competence. Similarly, Olson and Bialocerkowski (2014, p. 242-243) have sug¬ 
gested moving away from the “single factor cause-effect thinking” to “how different types 
of IPE produce different types of outcomes within particular learning environments.” 
Further, Cooper (2004) provided a compelling argument for using the complexity theory 
to guide IPE developments. 

With respect to the challenges of implementing and evaluating IPE, one fundamental 
consideration is the development of a pedagogically informed IPE curriculum (Oandasan 
& Reeves, 2005). IP learning opportunities informed by educational theories and learning 
strategies such as adult learning theory, case-based learning, small group learning, cooper¬ 
ative learning, and reflection on practice promise to improve attitudes, modify stereotypical 
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thinking, and transform learners to a more collaborative mode of practice (D’Eon, 2004; 
Oandasan & Reeves, 2005). In a longitudinal study of learner attitudes towards IPE and 
teamwork, Curran, Sharpe, Flynn, and Button (2010) identified the IP learning process, 
as informed by educational theory and IPE principles, as a key success factor. In a system¬ 
atic review to identity the best approach to pre-licensure, university-based, allied-health 
IPE, Olson and Bialocerkowski (2014) noted that case-based IPE activities involving small, 
stable groups of learners were perceived by participants as more relevant and successful. 

Centralized IPE offices are emerging to develop, implement, and evaluate pedagogi- 
cally sound IP learning opportunities; part of this process includes the creation of an 
inventory of such activities. However, it is not apparent whether any of these offices are 
systematically evaluating the attributes of the IP learning opportunities in terms of how 
they align with educational theory and IPE principles. In their systematic review, Olson 
and Bialocerkowski (2014) noted that most evaluations of IPE interventions lack a theo¬ 
retical foundation, are short-term, and assess such low-level outcomes as student readi¬ 
ness, attitudes, and interactions. The Medical University of South Carolina, Dalhousie 
University, Memorial University, and the Western University of Health Sciences have 
each published a description of the curricular and co-curricular IP learning opportunities 
offered and evaluated through their IPE offices (Aston, Mackintosh & Orzoff, 2010; Blue, 
2010; Curran et al., 2010; MacKenzie & Merritt, 2013). Consistent with Olson and Bialo- 
cerkowski’s (2014) findings, student assessment was the focus of these evaluations as op¬ 
posed to an examination of the attributes of each IP learning opportunity for the purposes 
of improvement. Moreover, there is a dearth of published data assessing whether estab¬ 
lishing a centralized IPE office has any measurable impact on the quantity and attributes 
of IP learning opportunities. 

The University of Manitoba (UofM) IPE Initiative (the Initiative) was formed in 2008 
by the deans of 13 health science academic units within the university. Establishing a 
centralized, university-wide office of IPE was viewed by UofM senior administrators as a 
critical step for exploring the development and implementation of IP learning opportu¬ 
nities. The primary goal of the Initiative was to help educate future health professionals 
as leaders and change agents who in turn will bring this way of thinking into the public 
domain for the benefit of the Manitoba health system and its recipients. Prior to the es¬ 
tablishment of the Initiative, the concept of IPE within the UofM was relatively novel. In 
2003, under a Health Canada-funded contract, Cook (2004) completed an environmental 
scan of IPE models utilized by Canadian universities. In his results, he noted that “there 
appears to be no active program of interprofessional learning at [the University of Mani¬ 
toba]” (Cook, 2004, p. 25). In 2005, through the Health Canada Interprofessional Educa¬ 
tion for Collaborative Person-Centred Practice Initiative, the UofM received funding for 
two demonstration projects. These projects created a growing awareness and acceptance 
of the benefits of IPE and interprofessional collaboration (IPC) and supported the educa¬ 
tional development of 15 UofM IPE ambassadors. These educators developed and offered 
learning opportunities in which pre-licensure learners from different health education 
programs learned together; they did so at a time when the “what and how” of IPE was in 
its infancy but the spirit was “start where you can and learn by doing.” 

Setting the bar for IPE at the time was the Accreditation of Interprofessional Health 
Education (AIPHE) project, which included a definition of what IPE is (and what it is not), 
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as well as guiding principles for the integration of IPE standards into professional educa¬ 
tion (AIPHE, 2009). Further, the Points for Interprofessional Education System (PIPES) 
is an instrument developed in 2009 by the University of Toronto, outlining the attributes 
of a pedagogically grounded IP learning opportunity (University of Toronto, 2009). 

As part of the Initiative’s strategic planning process and in an effort to harmonize 
language, reduce confusion, and avoid misunderstanding, the definition of IPE proposed 
by the Centre for the Advancement of Interprofessional Education (CAIPE) was adopted 
and operationalized: “occasions when two or more professions learn with, from and about 
each other to improve collaboration and the quality of care” (CAIPE, 2002). The Initiative 
also collectively endorsed the Canadian Interprofessional Health Collaborative (CIHC) 
National Interprofessional Competency Framework, which outlines six competency do¬ 
mains or desired behaviours for a collaborative practitioner, including: exploring the 
roles and responsibilities of healthcare practitioners; patient/family centredness; conflict 
resolution; shared leadership and decision making; and team dynamics and communica¬ 
tion (CIHC, 2010). Further, the Initiative set out to capture the IP learning opportunities 
in terms of how they aligned with the emerging understanding of “what is and what is not 
IPE,” and they chose to use the PIPES instrument to do so. 

The research question for this study was: What, if any, changes in the number and 
attributes of IP learning opportunities occurred in the academic year 2008-2009 com¬ 
pared to 2011-2012? 


Methods 


Ethical Considerations 

This study was reviewed and approved by the University of Manitoba Health Research 
Ethics Board. 

Research Design 

In its commitment to continuous educational improvement in IPE, the Initiative con¬ 
ducted regular surveys to evaluate the attributes of the IP learning opportunities offered. 
The research design for this project was a case-study comparative analysis of IPE offer¬ 
ings at the UofM between two academic years. The methodology involved a longitudinal 
secondary analysis of the data gathered from surveys conducted during the 2008-2009 
and 2011-2012 academic years (University of Manitoba Interprofessional Initiative, 
2014). Finlayson, Egan, and Black (1999, p. 84) defined secondary analysis as the “re¬ 
examination of previously collected data.” 

Questionnaire Development and Data Collection 

As an improvement tool, the items in the 2009 questionnaire were guided by the op¬ 
erational definitions and principles outlined in the AIPHE principles document and the 
PIPES (AIPHE, 2009; Wagner, Langlois, Lowe, & Simmons, 2009). Questionnaire items 
were developed for one of two purposes: to gather specific information on each IP learning 
opportunity (IPLO) so as to permit PIPES scoring, and to document additional informa¬ 
tion of interest on each IPLO (e.g., mandatory, elective, or voluntary offering; numbers 
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of students; student assessment; educational approach). For the purposes of this study, 
IPLOs were labelled “embedded” if they were a mandatory component of a mandatory 
or elective course as opposed to voluntary student involvement in extracurricular or not- 
for-credit activities or events. This definition is consistent with that articulated by Lawlis, 
Anson, and Greenfield (2014). In 2009, the questionnaire containing 15 items was piloted 
by two teams of course instructors prior to its distribution. The 2012 questionnaire was 
further revised, resulting in seven additional items, as some of the 2009 items were noted 
to be ambiguous and required either rewording, splitting into more than one question, or 
the addition of new items for further clarification. 

The questionnaire was emailed by the Initiative to members of the IPE Liaison Ad¬ 
visory committee in August 2009 (as a PDF) and March 2012 (using Survey Monkey), 
requesting that it be distributed widely among their faculty and that all completed ques¬ 
tionnaires be returned within 30 days. Faculty were asked to complete the questionnaire 
if they offered a learning opportunity in which (i) students from two or more different 
professions were brought together to learn together and (ii) there was an opportunity 
within the session for the students to interact. Each questionnaire requested information 
on only those IPLOs offered in that respective academic year (2008-2009 and 2011- 
2012). For any one IPLO, the relevant course instructors were requested to work col- 
laboratively so only one questionnaire was completed, regardless of how many academic 
units were involved. For both years, the questionnaire was also emailed to the president 
of the Manitoba Health Sciences Student Association (MaHSSA) to gather data on any 
student-inspired activities. 

For this secondary analysis, the research team found the need to adapt the PIPES in¬ 
strument (with permission) to improve its content and face validity. The original PIPES 
listed eight attributes of a pedagogically informed IPLO, falling within two constructs 
(process of learning and content). These attributes were developed by the University of 
Toronto IPE Office using a modified Delphi process involving an expert panel who par¬ 
ticipated in two rounds of decision making to select and rank key criteria relevant to IPE 
(Wagner et al., 2009). The UofM adaptation of the PIPES included nine attributes, with 
each attribute being further validated by one or more supporting educational theories 
and/or evidence-based learning strategies (Oandasan & Reeves, 2005). Table 1 compares 
the attributes and scoring for the original UofT PIPES instrument with the attributes and 
scoring for the UofM adapted PIPES instrument. Interprofessional learning opportunities 
that are case-based, facilitated, offer opportunities for debrief, involve small, interactive 
groups of learners, and are relevant to real practice received high scores on the adapted 
PIPES. Points were allocated for each of the nine attributes and summed. Each IPLO was 
categorized as “Green” for summed scores greater than 55 (highest quality), “Orange” for 
scores between 45 and 55, or “Red” for scores between 30 and 40. If an IPLO did not ad¬ 
dress at least two process and two content areas and accrue a minimum of 10 process, 10 
content, and a total of 30 points overall, it was labelled “Not IPE.” The adapted PIPES in¬ 
strument is available on the Initiative website (University of Manitoba Interprofessional 
Education Initiative, 2014). 
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Data Analysis 

Data was analyzed and tabulated using descriptive statistics (frequencies, summed 
scores) by survey year. A single research technician re-scored and re-tabulated all ques¬ 
tionnaire responses for both survey years using the adapted PIPES. Tabulated data were 
sent back to survey respondents for their verification. Questionnaire responses were fur¬ 
ther validated and modified based on a review of any available course material (e.g., facili¬ 
tator guides, student manuals, or handouts). Any discrepancies or misinterpretations were 
discussed between the research technician and the senior investigator to reach consensus. 

Results 

In 2009,11 of the 12 participating academic units (91.7%) responded to the question¬ 
naire, with 11 IPLOs reported. In 2012,12 of 13 academic units (92.3%) responded to the 
questionnaire, also reporting 11 IPLOs. Notably, nine of the 11 IPLOs reported in 2009 
were not reported in 2012. 

General Information on Each IP Learning Opportunity 

Tables 2 and 3 outline an overall description of the IP learning opportunities reported 
in both survey years. The number of academic units involved in two or more IP learning 
opportunities increased from six in 2009 to 11 in 2012 (an 83.3% increase). In 2012, Den¬ 
tistry participated in only one IPLO, and the Physician Assistant Program, which joined 
the Initiative in 2011, had not yet participated in an IPLO. The number of students in¬ 
volved in any given IPLO in 2009 ranged between eight to 168, with a total of 560 stu¬ 
dents participating in all IPLOs offered that academic year. This compared to a range of 
three to 378 students participating in any given IPLO offered in 2012, with a total of more 
than 1,081 students participating in all IP learning opportunities offered that academic 
year (a 93% increase). Notably, approximately 2,200 students are enrolled in the 13 par¬ 
ticipating academic programs, which range between one and four years. 

The proportion of IPLOs that were embedded into existing courses increased from four 
of the 11 IPLOs reported in 2009 to six of the 11 IPLOs in 2012. Most other IPLOs offered 
either voluntary involvement of students or involved a combination of students enrolled in 
mandatory or elective courses and participating on a voluntary basis. In both survey years, 
for most of the IPLOs that were embedded within a course, the course had relevance to the 
“learning common” that was the subject matter of the IPLO. The Initiative uses the term 
“learning common” to describe the content or the “vector” through which the “process” of 
developing collaborative knowledge, skills, and attitudes occurs. Learning commons in¬ 
cluded health and aging, bioethics, gerontology, social determinants of health, ergonomic 
risks and solutions in dental hygiene, health promotion, and practice education. 

For 2012, all of the 11 IPLOs had students from different years of education. For ex¬ 
ample, the social determinants of health IPLO involved students from eight different aca¬ 
demic units enrolled in the first to fourth year of their professional programs. Small group 
sessions and case-based learning were most commonly reported in both survey years. 
However, it is noteworthy that the diversity of IPE approaches increased from 2009 to 
2012, with observation and simulation being introduced as teaching strategies in 2012. 


CJHE / RCES Volume 46, No. 4, 2016 



Quantifying Interprofessional Learning / R. E. Grymonpre, H. J. Dean, M. James, P. F. Wener, 

A. E. Ready, L. L. MacDonald, M. E. Holmqvist, & M. W. Fricke 


Table 2. 

Description of Interprofessional Learning Opportunities in 2009 


Learning Com- 

Academic Unit (number of 

Student Level 

Learning Format 

mon 

students participating) 

Mandatory and 
Embedded (unless 
specified) 


Social Determi- 

Dental Hygiene (26) 

Year 1 

Group project 

nants of Health 

Physical Therapy (50) 

Year 2 

Small group sessions 


Occupational Therapy (50) 

Year 1 



Dentistry (30) 

Year 2 


Genetics Coun- 

Clinical Health Psychology (7) 

Year 1 

Small group sessions 

selling 

Medical Genetics (1) 


Case based 

Health and 

Kinesiology (15) 

Years 2-4 (elective) 

Small groups 

Aging* 

Nursing (5) 

Years 1 & 2 (elective) 

Case based 


Human Ecology (10) 

Years 3 & 4 (elective) 



Social Work (10) 

Years 1-3 (elective) 


Gerontology 

Nursing (16) 

Year 2 

Practice education 


Occupational Therapy (2) 

Year 2 (voluntary) 

Small group 

Case based 

Standards of 

Kinesiology (76) 

Year 1 

Small group sessions 

Conduct 

Recreation Management (40) 
Physical Education (45) 
Science (3) 

Undeclared (4) 



Risk Reduction 

Kinesiology & Recreation 

Year 4 (elective) 

Practice education 

Strategies 

Management (15) 


Case based 

Various Topics 

Pharmacy (18) 

Year 4 (elective) 

Practice education 

(Pharmacy) 



Case based 

Social Aspects of 

Human Ecology (10) 

Various years 

Small group sessions 

Aging* 

Nursing (10) 

Social Work (10) 

Arts (5) 

Others (5) 

(elective) 

Case based 

Surgical Reha- 

Kinesiology & Recreation 

Years 2-4 (elective) 

Practice education 

bilitation 

Management (10) 

Medical Rehabilitation (2) 

Years 2-4 

Case based 


Medicine (2) 

Internship 


Rehabilitation 

Kinesiology & Recreation 

Years 2-4 

Practice education 

Techniques 

Management (60) 


Case based 

Professionalism 

Kinesiology (14) 

Years 3&4 (elective) 

Practice education 


Recreation Management (9) 


Case based 
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Table 3. 

Description of Interprofessional Learning Opportunities in 2012 


Learning Common 

Academic Unit (number of 
students participating) 

Student level 
Mandatory and 
Embedded (un¬ 
less specified) 

Learning 

Format 

Social Determinants 

Dental Hygiene (26) 

Year 1 

Small group 

of Health 

Dentistry (29) 

Year 2 

Group projects 


Occupational Therapy (50) 

Year 1 



Pharmacy (55) 

Year 1 



Physical Therapy (50) 

Year 2 



Respiratory Therapy (15) 

Year 2 


Genetics Counselling 

Clinical Health Psychology (8) 

Year 1 & 2 

Small group 


Genetics (1) 

Year 1 & 2 

Case based 

Bioethics 

Occupational Therapy (50) 

Year 1 

Small group 


Physical Therapy (50) 

Year 2 

Case based 


Medicine (110) 

Year 1 


Ergonomic Risks and 

Dental Hygiene (52) 

Year 1 & 2 

Small group 

Solutions in Dental 
Hygiene 

Occupational Therapy (50) 

Year 1 (elective) 

Observation 




Case based 

Health Promotion 

Dental Hygiene (22) 

Year 2 

Small group 


Human Ecology (23) 

Year 4 

Case based 


Kinesiology (26) 

Year 4 



Medicine (107) 

Year 1 



Nursing (87) 

Year 4 



Occupational Therapy (49) 

Year 2 



Pharmacy (52) 

Year 2 



Social Work (12) 

Year 4 


Practice Education: 

Clinical Health Psychology (2) 

PGYl & PGY2 

Small group 

Primary Care 
(Shared Mental 

Psychiatry resident (1) 

PGY2 

Case based 

Health) 



Practice education 

Practice Education: 

Dental Hygiene (26) 

Year 2 

Small group 

Specialty Care 

(Youth with 

Medicine (7) 

Year 4 

Case based 

( 1 UUUi VV1L11 

Diabetes) 

Paediatric residents (11) 

PGYl 

Group projects 


Pharmacy (3) 

Year 4 (elective) 

Practice education 


Nutrition- dietetic interns (3) 

Year 1 


Practice Education: 

Medicine (4) 

Year 3 

Small group 

Tertiary Care 

Nursing (11) 

Year 3 & 4 

Case based 


Occupational Therapy (5) 

Year 2 

Practice education 


Pharmacy (4) 

Year 4 



Respiratory Therapy (3) 

Year 3 



Social Work (3) 

Year 3 & 4 
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Healthcare Team 
Challenge 

Medicine (8) 

Nursing (5) 

Human Ecology (3) 

Physical Therapy (2) 
Respiratory Therapy (3) 
Occupational Therapy (1) 
Pharmacy (1) 

Recreational Management (1) 

All (voluntary) 

Small group 

Case based 

Simulated Overnight 

Medicine (17) 

Year 1&2 

Simulation 

Hospital Ward 

Nursing (25) 

Pharmacy (6) 

Year 2&3 

Year 3 

(Voluntary for 
all) 

Case based 

Inner-city Community 

Human Ecology (1-6) 

Year 4 

Service delivery 

Care 

Medicine (1-5) 

Nursing (1-5) 

Occupational Therapy (~ 4) 
Pharmacy (6) 

Year 1 or 2 

Varied 

Year 2 

Years 1 & 2 

(Voluntary for 
all except OT) 

Case based 


PIPES Attributes and Scoring 

The 2012 survey noted substantial improvements in the process and content attri¬ 
butes of the PIPES instrument (Tables 4 and 5). In 2009, two of 11 IPLOs scored as “Not 
IPE,” with only four meeting the criteria for the highest quality IP learning. In contrast, by 
2012, the attributes of all offerings had improved, with none of 11 reported IPLOs scoring 
as “Not IPE” and eight meeting the criteria for the highest quality IP learning. 

Process attributes of the PIPES relate to the level of student interactivity, group-to- 
facilitator ratio, facilitator training in IPE, diversity of disciplines represented in groups, 
and frequency of interaction. Most notable improvements in the process attributes in¬ 
cluded a greater number of IPLOs in 2012 meeting the minimum criteria for small group 
facilitation (group-to-facilitator ratio < 3:1) (10 in 2012 compared to five in 2009) and 
facilitator training (i.e., at least 50% or more of facilitators receiving formal as opposed to 
informal or no training) (seven in 2012 compared to two in 2009). 

Content attributes of the PIPES relate to authenticity of the learning activity, explicit 
statement of IP learning objectives, use of case-based learning, and opportunities for stu¬ 
dent debriefs. Most notable improvements in content attributes included a greater num¬ 
ber of IPLOs that specified IP learning objectives (seven of the 11 IPLOs offered in 2012 
compared to only two of the 11 IPLOs reported in 2009). Further, 10 of the 11 IPLOs 
reported in 2012 involved interprofessional debriefs among students, compared to only 
four of 11 IPLOs in 2009. 
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Exemplar l: Interprofessional Clinical Placements 

With a PIPES score of 90 (the maximum achievable), the highest score of all IPLOs 
reported in 2012, IP clinical placements are highlighted as exemplary. It is important to 
note that the format of IP clinical placements varied by the mentoring practice environ¬ 
ment, thus PIPES scores would also vary between IP clinical placement sites. 

While allowing for some flexibility in format, senior learners from two or more differ¬ 
ent professions participating in their “uniprofessional” clinical placements were placed 
simultaneously in a “collaborative practice and learning environment” that provided for¬ 
mal opportunities for students to learn about, with, and from each other. The “gold stan¬ 
dard” educational format was grounded in Kolb’s experiential learning theory, with IP 
teams cycling through Kolb’s four stages: concrete experience, reflective observation, ab¬ 
stract conceptualization, and active experimentation (Kolb, 1984). The experience began 
with the IP student team attending a facilitated “setting directions” session, at which time 
a “patient of the week” and one or more collaborative competencies were selected. Over 
the “week” (or other timeframe, as appropriate), students participated in an IP shared 
care planning session and an IP case presentation to the mentoring team (concrete ex¬ 
perience); they observed and reflected on their own and their mentoring team’s behav¬ 
iours around the selected collaborative competency(ies) (reflective observation); and they 
ended the learning experience with a facilitated debrief (abstract conceptualization). Ef¬ 
forts were made by the mentoring team to engage the IP student team in more than one 
such opportunity with new patients and in new contexts (active experimentation). These 
activities were specifically designed to be embedded into existing clinical placements, as 
students are normally expected to develop uniprofessional care plans for their patients 
during their traditional clinical placements. The unique feature of this IPLO was that each 
student shared their uniprofessional care plan for the same patient, and together students 
created a “shared care plan.” Facilitators at the clinical site who were front-line providers 
may or may not have had training in IP facilitation. An “IP Clinical Placement Module” 
was distributed in advance to students and preceptors, outlining learning objectives rela¬ 
tive to five collaborative competencies (the manual was developed prior to the publication 
of the CIHC’s six collaborative competencies) and including a variety of tools to facilitate 
learning. The module is available on the Initiative website (University of Manitoba Inter¬ 
professional Education Initiative, 2014). 

Exemplar 2: Learning Health Promotion Interprofessionally 

Applying the PIPES instrument, this IPLO scored 75 and is therefore another high- 
quality IPLO offered within the UofM. The overarching goal of this IPLO is to foster in¬ 
terprofessional groups of students learning about, with, and from each other. Educators 
developed specific learning objectives on interprofessional team communication and 
health promotion to guide the IPLO. During the session, students from different health 
professions applied the population health promotion model to address issues presented 
in a case study, while developing the skills and attitudes that were foundational to inter¬ 
professional team communication. In keeping with the Initiative’s guiding principle of 
“embed rather than add on,” this half-day session was offered once in the fall semester 
and once in the winter semester to accommodate the timing of a course that each academ¬ 
ic unit taught on health promotion. The fall offering involved approximately 180 students 
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from dentistry, physician assistant, nursing, social work, and respiratory therapy, and the 
winter offering involved approximately 450 students from dental hygiene, human ecol¬ 
ogy, kinesiology and recreation management, medicine, nursing, occupational therapy, 
physical therapy, pharmacy, and social work. 

The initial meeting between participating students occurred online and included a self¬ 
introduction. Completing the introduction released online pre-readings, videos, and base¬ 
line quizzes on health promotion and interprofessional communication skills. In small, 
educator-facilitated groups of 10 people, students met face to face for a three-hour case- 
study session. The format for the session included discussion of the case as well as specific 
times for explicitly reflecting and debriefing on the group’s team communication skills. 

The IPLO was embedded within the relevant courses for all participating academic 
units. Student participation was mandatory, with a grade assigned for the activity (2.5% for 
a health promotion quiz and 2.5% for the facilitator’s assessment of team communication). 
Deans and department heads provided facilitators from their academic unit at a student- 
to-facilitator ratio of 10:1. All facilitators had participated in at least three hours of training. 

Discussion 

Use of the PIPES instrument helped to characterize and compare the changes that had 
occurred in IPE within the UofM in the 2008-2009 and 2011-2012 academic years. The 
results of this longitudinal analysis indicated there had been an increase in the number 
and positive attributes of IPLOs offered between the two survey years, the time period 
in which the Initiative had been formed and held accountable to its mission to foster the 
development and implementation of IP learning. At baseline, before the Initiative was es¬ 
tablished, many course instructors reported educational strategies that brought together 
students from multiple professions but were typically not based on the definitions, attri¬ 
butes, and theoretical underpinnings of IPE later adopted by the UofM. The increase in 
the number of mandatory and embedded IPLOs between survey years was also notewor¬ 
thy, as embedding IP learning into health professional curricula has been identified as 
one of five key “fundamental elements” that enable sustainable IPE (Lawlis et al., 2014). 

The date of the baseline survey (2008-2009) coincided with the establishment of the 
UofM IPE Initiative. In a separate manuscript, we report on how, since 2008, the Ini¬ 
tiative has used an adoption model framework entitled Interprofessional Education for 
Collaborative Patient-Centred Practice (IECPCP): An Evolving Framework (D’Amour & 
Oandasan, 2005) to guide the strategic implementation of IPE within the UofM and to 
facilitate the diffusion of IECPCP between the UofM and other organizations and sectors 
(Grymonpre et al., 2016). It is likely that the systems approach used to advance IECPCP 
and the simultaneous engagement of stakeholders and change-management strategies at 
the macro , meso, and micro levels had some influence on the findings of this study. 

There were a number of limitations with and challenges in conducting this survey. It 
is notable that nine of the IPLOs reported in 2009 were not re-reported in 2012. Although 
our study design did not permit us to examine this finding further, reasons were likely 
multifactorial and included (i) an increased awareness of what is not IPE, (ii) non-survey 
response due to staffing changes in IP faculty ambassadors, and (iii) IP learning opportuni¬ 
ties that may not have been offered consistently every academic year. It is also possible that 
there was confusion about how to best complete the survey, and reporting bias may also 
have played a role. Further, the number of practice education IP learning opportunities 
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identified is likely an underestimate. Although IP clinical placements coordinated through 
the Initiative were noted as exemplar IPLOs for senior students, there were likely many 
more clinical environments that were offering IP practice education outside of the Initia¬ 
tive but were not notified about the survey. Further, an important limitation of the PIPES 
tool is that quantity does not necessarily equal quality; for example, small group learning, 
although an important IP learning strategy, is only good if effectively facilitated. A final 
limitation is that we do not have evidence to date that learning opportunities that score 
higher on the PIPES tool lead to better educational outcomes. A study to evaluate the psy¬ 
chometric properties, including the predictive validity of the PIPES tool, has been planned 
and will be important in determining whether closer adherence to theoretically derived at¬ 
tributes of IPE does, in fact, lead to predicted changes in attitudes, beliefs, and behaviours. 

Despite the positive findings in this study, suggesting the successful implementation 
of many IPLOs at the UofM, this study also revealed areas needing improvement. The IP¬ 
LOs typically involved learners within IP groups at different levels in their academic pro¬ 
gram relative to both the learning common and the collaborative competency. Whether 
students learn best with students who are in the same year of their respective program 
is not known. As aptly stated by Oandasan and Reeves (2005, p. 34) regarding IPE: “We 
know many of the ingredients that are needed, but may not be sure how best to mix them 
together to create effective IPE.” For many academic units, the placement of IPLOs within 
their longitudinal curriculum has not been strategic. The development of collaborative 
competence requires advancement of knowledge (cognitive), attitudes (affective), skills 
and behaviours (psychomotor), and group relationship abilities (social) along a learn¬ 
ing continuum within a purposely “scaffolded” curriculum of increasing complexity and 
varying contexts, environments, and knowledge (D’Eon, 2005). An important next step 
for these academic units is to map out the most appropriate timing of each IPLO along a 
learning continuum within its respective longitudinal curriculum. 

Memorial University’s evaluation of their embedded IPE learning continuum is of par¬ 
ticular relevance (Curran et al., 2010). In a longitudinal analysis of students’ attitudes to¬ 
wards IPE and teamwork and their satisfaction with the IPE curriculum, no significant 
improvements were detected over the three-year study period. Reflecting on the process 
component of Freeth and Reeves’s (2004) 3P model of learning and Olson and Bialocer- 
kowski’s (2014, p. 242) reconceptualization of IPE as a “process within a system,” the var¬ 
ied teaching strategies, the diversity of professions represented in each IPLO, and the un¬ 
specified level of interactivity within the summed instructional contact hours detailed in 
the Memorial evaluation make it difficult to determine which factors could be improved. 
We suggest that the use of a standardized tool evaluating IPLOs’ attributes may ease the 
identification of relevant pedagogical targets. The PIPES score is posed as one standard¬ 
ized, novel dimension of an educational intervention within the nonlinear and complex 
dynamic of IPE. Analogous to a “pack years” calculation, which quantifies smoking load 
and is recognized as a strong predictor of negative health outcomes (Masters & Tutt, 
2007-2013), with further validation, the concept of “PIPES hours,” quantifying the hours 
and attributes of IP learning, may be one potentially significant predictor of collaborative 
competence—the desired educational outcome of an IPE curriculum. Further, the kind of 
feedback provided by the PIPES can be helpful to guide the design, implementation, and 
evaluation of IPE curricula. In our setting, instructors initially received feedback (i.e., their 
scores) after providing information about an IPLO that had already been completed. We 
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observed, however, that several instructors went on to use the PIPES as a guideline when 
developing new opportunities or modifying existing ones, and we anticipate that in the fu¬ 
ture, the PIPES framework will be helpful in informing process and outcome evaluations. 

Concluding Comments 

This longitudinal survey provides valuable information about the changes seen in the 
IP learning opportunities offered at the UofM between 2008 and 2012 and suggests that 
a strategic approach to the implementation and diffusion of IPE using an adoption model 
framework had some influence on these changes. Although some academic units were of¬ 
fering significantly more opportunities for IPE than others, it was encouraging to learn that 
all of the responding academic units reported involvement in at least one IPLO, and that the 
PIPES on IPLOs offered at the UofM had increased between the two survey years. The need 
for more strategic development and implementation of IPLOs along a learning continuum, 
especially within the clinical practice environments, was identified. The PIPES served as a 
useful tool for monitoring IPLOs over time and for informing course instructors on how to 
better align a given IPLO with educational theory and IPE principles. Further, in terms of 
the longitudinal evaluation of an IPE curriculum’s effectiveness for achieving its desired 
educational outcome of collaborative competence, we propose (pending further validation) 
the concept of “PIPES hours” as one potentially important predictor variable. 1 ^ 
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